General Disclaimer 


One or more of the Following Statements may affect this Document 


• This document has been reproduced from the best copy furnished by the 
organizational source. It is being released in the interest of making available as 
much information as possible. 


• This document may contain data, which exceeds the sheet parameters. It was 
furnished in this condition by the organizational source and is the best copy 
available. 


• This document may contain tone-on-tone or color graphs, charts and/or pictures, 
which have been reproduced in black and white. 


• This document is paginated as submitted by the original source. 


• Portions of this document are not fully legible due to the historical nature of some 
of the material. However, it is the best reproduction available from the original 
submission. 


Produced by the NASA Center for Aerospace Information (CASI) 




(NASA-CF-1 43203) CK CFUflAL SOFT- C I C IS 1C N 
CEHODUL ATICK (Nctce Late Univ.) 24 f HC 


N75-2di15 


13.25 


C SCI C9C 


UllCldS 

G 3/33 29H40 



"Department of 

ELECTRICAL ENGINEERING 


t 


UNIVERSITY OF NOTRE PA ME, NOTRE DAME, INDIANA 


ON OPTIMAL SOFT-DECISION DEMODULATION* 


Lin-nan Lot* 

Department of Electrical Engineering 
University of Notre Dame 
Notre Dame, Indiana 46556 


Technical Report No. EE-753 
July 1, 1975 


A bstract : Wozencraft and Kennedy have suggested that tne appropriate demodulator 

criterion of goodness is the cut-off rate of the discrete memoryless channel 
created by the modulation system; the criterion of goodness adopted in this note 
is the "symmetric" cut-off rate which differs from the former criterion only in 
that the signals are assumed equally likely. Massey's necessary condition for 
optimal demodulation of binary signals is generalized to M-ary signals. It is 
shown that the optimal demodulator decision regions in likelihood space are 
bounded by hypcrplancs. An iterative method is formulated for finding these 
optimal decision regions from an initial "good guess." For additive white 
Gaussian noise, the corresponding optimal decision regions in signal space are 
bounded by hypersurfaces with hyperplane asymptotes; these asymptotes themselves 
bound the decision regions of a demodulator which, in several examples, is shown 
to be virtually optimal. In many cases, the necessary condition for demodulator 
optimality is also sufficient, but a counterexample to its general sufficiency 
is given. 
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I. INTRODUCTION 

The block diagram of a one-way, coded, digital coruaunl cat ions system is 
given In Figure 1. From this figure, it is apparent that modulation and coding 
are both aspects of the "signal design" problem, whereas demodulation and de- 
coding are both aspects of the "signal detection" problem. The natural question 
then is hew to coordinate the design of the modulation system and the coding 
system so as to produce an efficient «ind effective communications system. 



Figure 1. A one-way, coded, digital communications system. 


Suppose that the modulator is M-ary; then, without loss of generality ,- we 
may consider the modulator input alphabet to be the set {0, 1, 2, ..., M-l}. 
Suppose the demodulator is restricted to J different decisions, then we may 
take its output alphabet to be {0, 1, 2, ..., J— 1 } . We s:y that the demodulator 
makes "hard-decisions" or "soft-decisions" according as to whether J ■ M or 
J > M respectively. Clearly, the "classical" modulation s>stem design criterion 
of "error probability" is applicable only for hard-decisions. Unfortunately 
for classicists, the use of a hard-decision demodulator generally reduces 
substantially the effectiveness of the coding system. 

Wozencraft and Kennedy [1] were the first to suggest that the proper modula- 
tion system design criterion is the "cut-off rate," R , of the M-input, J- 
cutput discrete menoryless channel (DMC) presented by the modutat ion system to 
the coding system. Tills DMC is completely described by the transition proba- 
bilities, P(j|m), that the demodulator decision is j given that the modulator 
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input was m, 0 J < J, 0 w < M. Mathematically, the cut-off rate is given 

by 

R - -log. {“q 11 l [ l Q(m)i/P(j | m) ] 2 } (1) 

0 * ^ J-0 m-0 

where Q is a probability distribution for the channel input letters, i.e., 

Q(ra) j> 0 for all m and Q(0) + Q(l) + ... 4 Q(M-l) - 1. 

Wozencraft and Kennedy were led to the choice of R q (or, as it was then 

usually denoted, "R cocl p") because K q is the upper limit of code rates for 

which the average decoding computation per digit is finite when sequential 

decoding is used. More recently, Massey [2] has pointed out a more persuasive 

reason for choosing R^ as a design criterion. Viteibi [3] has shown that, when 

convolutional coding is used with maximum likelihood decoding on the »>MC # then 

the decoding error probability is upper bounded by 

-NR 

P < c_L2 °, if R < R , (2) 

e R o 

where N is the code constraint length, R is the code rate (number of data bits 
per decoded letter), L is the number of bits encoded, and is an unimportant 

constant independent of N and L. Hence, as Massey observed, the single number 
R q determines both a range of rates over which reliable operation is possible 
as well as a measure of the necessary coding complexity to obtaii a specified 
error probability. R q is thus even more informative than the channel capacity 
of the DMC which, although it determines the entire region of rates over which 
reliable communications is possible, says nothing about the coding complexity 
needed for a specified decoding error probability at any given code rate. 

In the same paper (2], Massey established a number of fundamental results 
about modulation systems under the R q criterion. He gave a general expression 
for for unquantized demodulation (J=°°) , and proved that, for any given M, 
the M-ary simplex signal maiimizes the unquantized for the additive white 
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Gaussian noise (AWGN) channel. For binary modulation (M-2) and any given J, 
Massey also gave a necessary condition for the demodulator decision regions 
to be optimal, and showed how to use thin condition as the basis of an Iterative 
computational technique for finding the optimal decision regions. 

In this note, we extend Massey's necessary condition for optimal demodula- 
tion to the non-binary (M>2) case, and we give an example which shows that the 
condition is not sufficient even in the binary case. We show that, in likeli- 
hood space, the optimal demodulator decision regions are always bounded by 
hyperplanes, and we give some examples to illustrate the nature of these regions. 


II. THE SYMMETRIC CUT-OFF RATE 


We define the symmetric cut-off rate , R q , to be the value of the righthand 

6ide of (1) when Q is the uniform distribution [Q(n) " l/M for 0 <_ m < M] rather 

than the minimizing distribution. Thus, 

- i J-l M-l , 

R - log,M —log- (w J I l /P(J |m) ) }. (3) 

‘ j-0 m-0 

Evidently, F( o <_ R q . Moreover, R^ ■ R q in the binary case (M=2) for which the 
uniform distribution is always the minimizing distribution, and also R q ■ R q 
in most other cases of practical interest where the modulation signal set and 
the demodulator decision regions are reasonably "symmetric." Furthermore, the 
bound of (1) becomes 


-Nil 


P c < c r L2 


', if R < , 


(4) 


when the code is such that each letter in the code alphabet appears in the 
same fraction of codewords, a situation that always occurs in the conventional 
convolutional codes that would be used in practice. Thus, both to reflect this 
practical situation and to obviate the awkward minimization over Q in (1), we 


henceforth take R^ of the resultant DMC as the measure of quality for the 


modulation system. 
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III. A NECESSARY CONDITION FOR OPTIMAL DEMODULATION 

Henceforth, we assume that we have made the standard transformation [4] 

from waveforms to signal space so that s(t) and the "relevant 1 ' component of 

r(t) In Figure 1 may be replaced by the corresponding vectors s and r_ in 

n-d linens ional Euclidean space. We let denote the transmitted signal when 

the modulation input is m. Any demodulator then may be viewed as a partition 

P , P.t •••! P. of m-space, where the "decision region" P is the set of all 
U 1 J— A J 

received vectors jr that cause the demodulator to emit the decision j . We 
now derive a necessary condition for the decision regions to be optimal for a 
given signal set and channel. 

Let p(r|m) be the probability density function, which we assume to be 
everywhere continuous, for the received vector r_ given that signal is trans- 
mitted over the channel. The transition probabilities of the resultant DMC, 
for a given demodulator, are then given by 

P (j | m) - j p(rjm)djr. (5) 

Let a and b, a f b, be two output letters of the demodulator such that V and 
V k are adjacent regions, i.e. the boundary between P, and P^ is a hypersurface 
in n-space, and let £ be any point on this bound. Next, consider transferring 


from V to P. a small region, P , , which includes the point p. [We show this 
a b 3 d 

situation in Figure 2 for the case n=2]. The resulting variation in the tran- 
sition probabilities is then seen from (5) to be 



Figure 2. The variation of the decision regions P and P, 

a d 

by transfer of the small region P . 

ab 
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»ui-> -{!& 


P(£ 


n)fiV J ■ b 

m)6V J ■ a 

otherwise , 


( 6 ) 


where we have now assumed that each p(rjm), 0 m < M, Is continuous at 
£ • £, and where 

6V 

L 


i iL 


is the volume of the small region If the decision regions are optimal, 

the resulting variation, 6^ o , of the symmetric cut-off rate, i^, must be 0. 
As we see from (3), the condition 6^ * 0 is equivalent to the condition 
6S ® 0 where 


J-l M-l , 

S - l I l ^P(J [m) ] . 
j«0 m»0 


(7) 


We then begin with 


J-l M-l 


* -Jo Jo wftar Wj|m) 


which, with the aid of (6) , becomes 

"- 1 JS 


55 - l 'WR - Wirt 1 p( al"> sv - 

m-u 

We next note that direct differentiation in (7) gives 


(8) 


M-l 


Tp77r-r “ l [ /PUTO) ~ : • 

/P(j J ' 

provided that P(j|m) + 0. Then, by using (9) in (8), we obtain 


(9) 


M-l - M-l _____ . M-l _____ 

6S - 7 [ — — l /H (b j i) - - — - - l i/P(n| i) ] p(£.|m)6V. 

m^O i/p(b | m) 1=0 /P(a|m) i"l 

Thus, the condition that <5S - 0 for an arbitrary 6V becomes 

M-l . M-l M-l 

l ( - - l /p"( 1>1 i) ■ - — l /P(a| i ) ]p(p^| m) - 0. 

nr*0 /F(b [ m) i**0 /p(a |m) i«0 


( 10 ) 
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Ue have thus proved: 

Theorem : The demodulator decision regions Vq, V 1° signal space 

can maximize R q only if, for every a and b, a { b, such that P(b|m) j 0 
and P(a|m) | 0 for 0 <_ m < M, and such that V * and P ^ share a hypersurfacc 
boundary, it is the case that (10) holds at every point £ ■ on this boundary 
which is a point of continuity of P(jr|m) for 0 <_ m < M. 

In the next section we shall give a more illuminating form of condition 

( 10 ). 

IV. DECISION REGIONS IN LIKELIHOOD SPACE 


For the received vector £, we define the waveform channel likelihood-ratio 
vector . A(r) * (A^O, A 2 (£), .... A M _ 1 <£) ] , by 


A(£) - [ 


p(fc 

1) 

p(r 

0) 


il p(x| 2) P(xJ M-l) . 

0) * ptrlo) p<7 0) J * 


(ID 


p(r |0) 

Ue note that, as pointed out by Massey [2], the demodulator can always, at its 
"front end'J map £ to Ml) with no loss of optimality. Thus, it becomes of 
interest to determine the form of the decision regions D^, D^, ..., D M _^ in 
likelihood space which correspond to the optimal decision regions Pq, , ..., 
P , in signal space. But, seeing from (11) that (10) may, after division by 
p(£_|0) (which wc now assume to be non-zero), be rewritten as the linear 
equation 


M-l 


M-l 


l I 


m-l /l’(b[ in) 4 -0 


l /l»(b | i) - 


/p(a[m) i-0 


M-i ___ 

l /ruTTj‘)A m ( £ )+ 


M-l 


/p(bioy i-o 


l /p(bfi) - 


/RaTojT 1=0 


M-l _____ 

l /P(a|i) - 0, (12) 


we have immediately our main result 

Corollary 1 : The demodulator decision regions P^, P^, ..., P,_^ in signal 
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spate can maximize ^ only if, for every a and b, a { b, such that P(b|m) f 0 
and P(a|m) f 0 for 0 m < M, and such that V & and V ^ share a hypersurface 
boundary, it id the case that every point jr ■ £_ on this boundary, which is a 
point of continuity of A( r) lies on the hyporplanc defined by (12). 

In other words, the optimal decision regions in likelihood space are 
always bounded by hyperplanes. This fact has considerable practical significance 
as It is difficult to implement circuitry which determines to what decision 
region some vector Mr) belongs except in the case when the decision regions 
are bounded by hyperplanes. 

Condition (12) can be placed in an even more transparent form. We note 
that wher (12) is satisfied, then 


T 

m 


/ P(bl0) 1- 0 


M-l 

l r'P(b|i) 


M-l 


M-l 


/ F(a fo ) 1**0 


l «^P(a | i) 




(13) 


/p(b | m) i“0 


l /P(b|i) - 


M-l 


► / P(7iTro)' 1-0 


l *^P ( a | i ) 


(provided the denominator is non-zero) is just the intercept on the m-th axis 
in likelihood space of the boundary hypcrplanc. [See Figure 3 for a graphical 
interpretation of T^. ] Thus, we have 

Corollary 2 : The demodulator decision regions Dq, D^, ..., Dj ^ in likelihood 

space can maximize H q only if, for every a and b, a ^ b, such that P(n|m) + 0 
and P (b | m) j 0 for 0 <_ m < M, and such that D and D, share a hypersurf ace 
boundary, it is the case that this boundary is a hyperplanc whose intercepts 
with the coordinate axes are given by equation (13). 
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l 





Figure 3: A hyperplane boundary in likelihood space 

separating the decision regions D and D, 
for the case M ■ 3. 



For the case of binary modulation (M * 2) , we note that (15) reduces to the 
necessary condition for optimality, 

T - A(b)X(a) (16) 


that was given by Massey [2). 
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V. EXAMPLES AND AN ITERATIVE OPTIMIZ'TTON TECHNIQUE 

In this section, we give some example* to illustrate the use of the necessary 

condition for demodulator optimality given by Theorem 1 and its corollaries. 

We also formulate a systematic method for finding the optimal demodulator 

decision regions by iteration from an in'r^ul guess. 

Example 1 ; Hard-decision demodulation (i.e., J ■ M) for M-ary phase 

modulation in additive white Gaussian noise (AWGN). In this case, the signal 

space Is 2-dimensional and the signal vector, s for 0 < m < M, may be taken 

— m 

as the point on the circle of radius i^E (where E is the signal energy) at an 
angle of (2n/M)m. The ternary (i.e., M ■ 3) case Is shown in Figure 4. The 
heavy lines in thi~ figure are the boundaries of the decision regions for a 



Fig. 4; Maximum-likelihood demodulation of 
ternary phase-modulated signals. 

maximum likelihood (ML) demodulator which, of course, is the hnrd-dccision 

demodulator that minimizes error probability when the signals are equally likely. 

We now show that the Ml. demodulator for phase modulation is also the hard- 

decision demodulator which maximizes R . Let s and s, be any two adjacent 

o — a -b J 
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* 

signals, i.e., Chcir phase difference is 2*/M. By the symmetry of the signal 

set and by the spherical symmetry of the additive white Gaussian noise, it 

follows that the ML demodulator causes the probabilities P(b|0), P(b|l), ..., 

P(b|M-l) to be a permutation of P(a|0), P(a|l), ..., P(a|M-l), and also that 

for each m such that P(b]m) f P(a|m) there is a correspondirf*, m' such that 

P(b|m) ■ P ( a | m ' ) , P(a|m) • P(b|m') and p(p.|m) • p(fijm') for on the boundary 

between V* and {2 . Thus, the terms in the summation on the lefthand side of 

(10) cither vanish singly [when P(b|m) ■ P(a|m)J or cancel .n pairs. Thus, 

the ML decision regions satisfy the necessary condition f< ; maximizing R q given by 
Theorem 1. Symmetry considerations Indicate this is the only local maximum of 
% and hence is the global nu lmum. 

As a specific numerical example, we lake the M • case of Figure 3 where 
E/N q ■ 1 , N q being the one-sided noise power spectra 1 density so that the 
variance of the noise in each dimension of signal '.pace is N q /2 The value of 
yielded by the optimal hard-decision demodulator is 0.3971. The unquantized 
for this case can be found from Massey's results [2] to be 0.6254 so that 
the penalty for hard-decisions is 1.97 dB. 

Example 2 : Quaternary demodulation (J ■ 4) for ternary phase modulation 

(M - 3) in AWGN. Symmetry considerations suggest that the optimal decision 
regions will consist of three regions, Pq, V ^ and having 120* rotational 
symmetry and containing the signals s^, and s^ respectively, together with 
an "erasure" region V ^ containing the origin in signal space. In this case, 
there will be probabilities p and q such that P(3|n) - q for all m, P(j|m) - p 
for j + m and j f 3, and P(j|m) - 1 - 2p - q for j - m. Substituting these 
parameters into the necessary condition for optimality (13), we find that the 
resulting optimal intercepts correspond to the straight lines 




f 
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A 1 * A 2 " C 

cA l " A 2 " 1 
-A. ♦ cAj - 1 


c • 2/p//l-2p-q. 


Thus, the optimal decision regions in likelihood space arc known up to the 

parameter c. By trying various choices of c for the specific case E/N q ■ 1 

and calculating R q for the DMC resulting from the demodulator corresponding to 

these decision regions, we find that, for the optimal decision regions, c ■ .486 

and the attained value of R is 0.4402 which is a 0.45 dB improvement over hard 

o 

decisions. In Fig. 5(a), we show the optimal decision regions in likelihood 


ace, while in Fig. 5(b) we show the corresponding regions in signal space. 



Fig. 5; Optimal decision regions for quaternary 
demodulation of ternary phase modulation 
in AVGN with F./N ■ 1 shown (a) in likelihood 
space*, and (h) In signal space. 
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We now describe a general iCerative procedure that may be used to find the 
optimal decision regions for J-ary demodulation given a particular M-ary 
signal set and a given channel. The basic idea is quite simple. Civen decision 
regions D Q , D^, .... Dj_^ bounded by hyperp! arcs , we note that, for some a f b 
such that D fl and are adjacent regions, the intercepts of the bounding 
hyperplane with the coordinate axes in likelihood space will satisfy (13) If 
the decision regions are optimal. If they are not optimal, we can use the 
numbers determined by (13) as the intercepts of a hyperplane which will be a 
better approximation to the optimal bounding hyperplane between D and D, . Our 
procedure may be stated as: 

Iterative Demodulator Optimiza t ion : 

Step 0 : Make an initial guess, , ..., for the optimal 

hyperplane-bounded decision regions in likelihood space. Set k ■ 1. 

Step 1 : Calculate P(j|m), 0 j < J and 0 <_ m < M, for the DMC croa .ed 

(kl (k) (k) 

by the decision regions I)q , , . . . , 

l (k) (k) 

Step 2 : Choose an a and b, a f b, such that D a and are adjacent 

and calculate x^+l)^ , •••! T^ from equation (13). [Note: If the 

decision regions are optimal, then these T's will be the intercepts of the 

(^0 *i 

boundary between and with the coordinate axes.J 

Step 3 : Take the boundary between and as the hyperplane 

whose intercepts with the coordinate axes are T^ 4 ^, T^ + ^ , ..., Tj • 

Step A : Repeat steps (2) and (3) until all such pairs a and b have been 

considered. 

Step 5 : If , ..., arc "sufficiently close" to 

(k) (k) (k) 

Dq , I)j , ..., D,_' , stop and take the former decision regions as the result 
of this optimization method. Otherwise, increase k by 1 and return to step 1. 
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Tvo remarks about tV hove Iterative method are in order. First, the 

most time-consuming part of the procedure is the calculation of the transition 

probabilities pfj|m) in step 1. This would ordinarily be done by mapping from 

(k) (k) (k) 

the decision regions Dq , ^j-1 *- n livelihood space to the corre- 

(k) (k) (k) 

sponding decision regions Pq , V ^ , ...» Pjj in signal space, then evalu- 

ating the integral in (5) either analytically or numerically. Secondly, we 
note that when M - 2, t^e above iterative procedure requires more calculation 
than the iterative method given by Massey [2] which is based on equation (16). 
Unfortunately, Massey's method docs not generalize to cases where M > 2. 

We now give two examples to illustrate the use of the above iterative 
optimization method. The first of these is a "hard-decision" case which jerves 
also to illustrate the fact that, when the signal set is not sufficiently 
symmetric, even in this case the decision regions which minimize demodulator 
error probability may not maximize R q . 

Example 3 : Hard-decision demodulation for the two-dimensional signal set 

Sq ■ 10,0], - [2,0] and ■ [0,2] in AWGN with variance N q /2 = 1/2 in each 

component. [The average signal-energy-to-noise-power-spectral-density-ratio, 

E/N , is 2.67 (or 4.26 dB) . ] In this case, the received vector r = [x,y] has 
o 

a likelihood ratio vector 

A Cr) - [A r A 2 ] - [e 4 *- 4 , .*^*1. 


Thus, the boundary straight-line (or hyperplane in two-dimensional space) 

T 1 A 1 + T 2 A 2 " 1 
corresponds to the curve 


1 4x-4 1 4y-4 , 

_ e + C J „i 

1 l 2 


(17) 


in signal space. 
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As Che boundaries between decision regions in Che initialization step 0 
of the algorithm, we choose those which minimize demodulator error probability, 
viz., the straight lines Aj » 1, A^ ■ 1, «'d Aj • shown in Fig. 6(a). Note 
that the boundary between D q and D,, is a reflection around the line A^ - Aj of 
that between D q and D^. This symmetry is preserved at successive Iterations 
of the algorithm because of the corresponding symmetry of the signal set about 
the line x ■ y and the symmetry of the AWGN. Thus, it suffices to determine 
the boundary between D q and D^. Letting (T^, Tj) be the intercepts of this 
boundary with the Aj and axes, respectively, and taking (1, -10^) as an ap- 
proximation to the Initial (1, -«) , we find, from application of the interative 
procedure in which we use (17) to determine the region over which the integral 
in (5) is to be evaluated numerically, the following succession of intercepts: 


( 1 , > 10 °) 

(0.8307, -0.5732) 
(0.8145, -0 4030) 
(0.8252, -0.3501) 


initialization 


1st iteration 


2nd iteration 


3rd iteration 


(0.8646, -0.3100) 


15th iteration 


up to the point where there is no further change in the 4th significant digit 
on further iteration. In Figures 6(b) and 6(c), we show the optimal decision 
regions for this example, as found by the iterative optimization procedure, in 
likelihood space and in signal space, respectively. 

The valc°iof K obtained as successive iterations were as follows: 


0.6388 


initialization 


0-6462 


1st iteration 


0.6476 


2nd iteration 


0.6480 


3rd iteration 


0.6482 


15th iteration. 


-1 


3 


4 



Figure 6. Hard decision demodulation of ternary signals: 

(a) The initial decision regions in likelihood space, 

(b) the optimal decision regions in likelihood space, 

(c) the optimal decision regions in signal space. 
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The optimal value of % is about 1.5% (or .06 JB) above that obtained for the 

o 

herd-decision demodulator which minimizes error probability. We see also that, 
for this example, the iterative procedure converged rapidly to the optimal 
demodulator — after only one iteration the resulting demodulator was effectively 

optimal. 

As can be seen from Fig. 6(c), the optimal decision boundaries have 
asymptotes which are straight lines (hyperplancs in two-dimensional space.) 
These asymptotes are shown by the dashed lines in the figure. If one uses 
these asymptotes as the boundaries of the decision regions for a sub-optimal 
demodulator, one finds th* resultant to be 0.6459 which is only .015 dB 
Inferior to the optimal hard-decision demodulator. We shall later discuss the 
practical significance of the near-optimality of these asymptotic linear 
boundaries in signal space. 

Example 4 : Quaternary demodulation ( J ■ 4) for the same ternary signal 

set (M - 3) and noise as in example 3. 

In Figure 7(a), we show the J ■ 4 decision regions used to Initiate the 
Iterative optimization procedure. The optimal decision regions in likelihood 
space and in signal space are shown in Figs. 7(b) and 7(c), respectively. 
Convergence to four significant digits of accuracy in the intercepts of the 
boundary lines with the coordinate axes required 25 iterations. The values of 
at successive steps were as follows: 


0.6536 

initialization 

0.6986 

1st 

iteration 

0.7045 

2nd 

iteration 

0.7057 

• 

• 

3rd 

iteration 

• 

• 

• 

0.7062 

25th 

• 

iteration; 
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Figure 7. Quarternary demodulation o£ ternary signals: 

(a) the initial decision regions likelihood space, 

(b) the optimal decision regions in likelihood space, 

(c) the optimal decision regions in signal space. 


.1271 



x 
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we see that Che decision regions after only two Iterations were effectively 
optimal. The optimal value of R q for quaternary demodulation Is about 8Z (or 
0.34 dB) above that for the Initial decision regions of Fig. 7(a), and Is about 
9% (or 0.37 dB) above that for optimal hard-declslon demodulation. 

In Fig. 7(c), the dashed lines (or hyperplanes In two-dimensional space) 
again are the asymptotes to the optimal decision boundaries in signal space. 

If these asymptotes are used as the actual boundaries between the decision 
regions In signal space, we find R q of the resultant demodulator to be .7031 
which is only .02 dB below optimal. 

In both Examples 3 and 4, we have seen that the linear (hyperplane) 
asymptotes to the optimal decision regions in signal space themselves bound the 
decision regions for a demodulator which is virtually optimal. The practical 
significance of this fact is that the resulting sub-optimal decision rule can 
be as easily implemented directly in signal space as can the optimal decision 
rule in likelihood space. There is no need for the conversion from signal 
space to likelihood space in order to obtain conveniently- implemented decision 
regions with linear (hyperplane) boundaries. 

In fact, it can be shown generally, for AWGN in an n-dinensional signal 
space, that the optimal demodulation regions in signal space are such that 
each bounding hypersurface has (at most) 2° * hyperpl me asymptotes. We con- 
jecture that these hyperplare asymptotes form the boundaries of decision reg ons 
for a demodulator that is virtually optimum, and hence that the mapping fro:, 
signal space to likelihood space is not necessary to obtain virtually optimal 
demodulation together with an easily-implemented decision rule. 
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VI. A COUNTEREXAMPLE TO THE SUFFICIENCY OF OPTIMALITY CONDITION (10) 

As we have pointed out above, condition (10) is actually the condition for 

an extremum of and hence not in general a sufficient condition for optimal 

demodulation. In the examples which we have studied wherein the noise was 

additive with a "smooth" density function, there has generally been only one 

6et of decision regions satisfying (10) so that the extremum was necessarily 

the global maximum of We now give an example to show, however, that it 

is possible for (10) to be satisfied for decision regions that define only a 

local maximum, or even a local minimum, of % . 

o 

Example 5 : Hard-decision demodulation for binary signals such that the 

conditional density functions for the likelihood ratio A are 

0 < A <_ 0.9 
0.9 < A £ 1.1 
1.1 < A £ 2.0 
2.0 < A 

and p^(A) - Apg(A) when the signals s^ and s^ are transmitted, respectively. 
(These are valid choices for these conditional density functions as they satisfy 
the constraints 

j P() (A)dA - | ?1 (A)dA 
0 0 

and A - p 1 (A)/p Q (A) 

that are the only ones that must be observed in the binary case.] 

For hard-decision demodulation with binary signalling, condition (10) 
reduces to Massey's condition (16), namely, 

T - /X(1)X(0) f 18) 

where T is the threshold between decision regions in likelihood space. 




P 0 < A > 
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(a) 



Figure 8. The binary, hard-decision, demodulation situation 

used to demonstrate the Insufficiency of optimality 
condition (10). 
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In Fig. 8(a), we show the conditional density functions for the likelihood 

ratio A, and in Fig 8(b) we show A(l) X(0) as a function of the threshold T 

between the decision regions in likelihood space. Ve see that condition (18), 

the necessary condition for optimal demodulation, is satisfied at three places, 

viz., 0.56, 1.06, and 1.16; the corresponding values of are 0.0123, 0.0066, 

and 0.0069, respectively. The third of these corresponds to a local, but not 

global, maximum of % . The second corresponds to a local minimum of % , while 

o o 

the first corresponds to the desired global maximum of That is, T - 0.56 

is the threshold between decision regions in likelihood space for the optimal 


demodulator. 


22 


VII. SUMMARY 

In this note, we have derived a necessary condition for « '.mal J-ary 
demodulation of M-ary signals, where optimality is taken to mear .uaximal'ty of 
the symmetric cut-off rate, of the resulting discrete memoryless channel. 

By means of a counterexample, we have shown that this condition is not in 
general sufficient for optimality. We have also used this necessary condition 
for optimality as the foundation for an iterative optimization method to find 
the optimal demodulator decision regions from an initial "good guess." 

In general, the optimal demodulator decision regions are bounded by 
hyperplanes in likelihood space. For the important case of additive white 
Gaussian noise, the corresponding optimal decision regions in signal space 
have hypcrplane asymptotes. In some examples, we have shown th; t the regions 
in signal space bounded by these asymptotic hyperplanes define demodulator 
decision regions which are virtually optimal, and we conjectured that this 
happy state of affairs (which permits near optimal performance with a decision 
rule that can be simply- implemented directly in signal space) holds in general. 
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